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ABSTRACT 

Linear programming models with 0-1 variables are 
useful for the construction of tests from an item bank. Most solution 
strategies for these models start with solving the relaxed 0-1 linear 
programming model, allowing the 0-1 variables to take on values 
between 0 and 1. Then, a 0-1 solution is found by just rounding, 
optimal rounding, or a heuristic. In most applications, the latter 
can be executed very rapidly. This paper uses the revised simplex 
method to solve the relaxed 0-1 linear programming method for test 
construction. The simplex method is modified such that the 
characteristics of test construction problems are taken into account. 
The mod3fica ions were implemented in the computer program LINPROG. 
Two item banks, each containing 450 items, were generated to 
detrirmine if central processing unit (CPU) time was gained. 
Computational experi:nents showed a gain of CPU time for most 
modifications. Ten tables presc \t the results for the modif icat:uon3* 
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Abstract 

Linear programming models with 0^1 variables are useful for 
the construction of tests from an item bank. Most solution 
strategies for these models start with solving the relaxed 
J-1 linear programming model, that is, the 0^1 variables are 
also allowed to take on values between 0 and 1. Then, a 0-1 
solution is found by just rounding, optimal rounding, or a 
heuristic. In most appli-:ations the latter can be executed 
very fast. This paper uses the revised simplex method to 
solve the relaxed 0-1 linear programming model for test 
c'>ns traction. The simplex method is modified such that the 
characteristics of test construction problems are takers into 
account. The modifications were implemented in the computer 
program LINPROG. Computational experiments showed a gain of 
CPU time for most modifications. 

Keywords: Test Construction, Item Banking, Linear 
Programming, Revised Simplex Method 
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A Revised Simplex Method 
for Test Construction Problems 



Developrients in item response theory and computer science 
have made it more convenient to build item banks. An 
interesting application of item banking is the corstruction 
of customized tests, that is, the selection of a test to meet 
the consumer's demands, Theunissen (1985) has shown that the 
problem of selecting items for a test (the test construction 
problem) can be solved using 0-1 linear programming. 
Generally, in linear programming a proble.a is translated into 
a model, which consists of a linear objective function and a 
number of linear constraints. For instance, in the 0-1 linear 
programming model by Theunissen, the objective was 
minimization of the number of items in the test under the 
constraints that the amount of test information at a few 
specified ability levels be larger than a prespecified 
quantity, Unti? now, most research has been directed to the 
problem of modeling a test construction problem as a 0-1 
linear programming model, and the problem of solving such a 
model has been given less attention in the literature on test 
theory. 

A linear programming problem without integer variables 
is solvable by the well-known simplex method. The simplex 
method was invented by G,B, Dantzig, A report of the 
development of the simplex method is given in Dantzig (1963), 
in computer codes, mostly the revised simplex method is used. 
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A description of the revised simplex method is given in this 
paper. The 0-1 linear programming problem is a special form 
of the integer linear programming problem, which can be 
solved by applying a branch-and-bound method (Land & Doig/ 
1960) . in a branch-and-bound method the simplex method is 
used repeatedly. Therefore, the ipethod is time consuming. To 
avoid this problem, other solution strategies for solving 
test construction problems have been proposed such as 
rounding, optimal rounding (van der Linden & Boekkooi- 
Timmingr, 1989) and a heuristic (Adema, Boekkooi-Timminga & 
van der Linden, in press) . In these solution strategies the 
relaxed 0-1 linear programming problem.- that is, the problem 
in which the variables are allowed to take on values between 
0 and }, is solved first. Then, given the solution to the 
relaxed problem, a good suboptimal 0-1 solution is computed 
very fast . 

If one wants to construct tests in an interactive mode, 
a fast method for solving the relaxed problem is needed, 
because this makes it more convenient for the test 
constructor to specify his/her demands, view the test, and 
possibly adjust the demands in one session. It is, therefore, 
interesting to study the possibility of reducing waiting 
times by implementing the simplex method for test 
const rue*- ion such that CPU time reduces ard minimal computer 
storage capacity is needed. The letter is important if one 
wants to contruct tests on a personal computer. In this paper 
implementations of the revised simplex method are presented 
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taking the special form of the 0-1 linear programming models 
for test construction into account. In particular, the 
Maximin Model (van der Linden & Boekkooi-Timminga, 1989) will 
be regarded, because this model has the advantage that the 
test constructor does not have to specify an absolute target 
test information function but only the relative shape of it. 

In the next section the Maximin Model is given. This 
section is followed by a description of the revised simplex 
method. Then, some modifications for the revised simplex 
method are given. Finally, the practical gain of the 
implementations in CPU time is shown. 



Maximin Model 

In this section the Maximin ^iOdel is formulated. Define the 
decision variables x^ as 

I 0 item i not in the test 
Xj^ = "S i=l,....,If 
I 1 item i in the test, 

where I is the number of items in the item bank. Let Ii(0K)' 

k = 1, , K; i = 1, , I be the information of item i at 

ability level 6}^. Ihe proportion of information required at 
ability level Qy^ is specified by r|^. The vector {rj^} 
constitutes a target for the test information function; the 
latter is considered discrete here to make it possible to 
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formulate the problem as. a 0-1 linear programming problem* 
The decision variable y aatermines the vertical location of 
the test information function. If N is the number of items to 
be selected for the test, then the Maximin Model can be 
wr-.cten as follows (the presentation of the model is followed 
by an explanation) : 

(1) maximize y, 

subject to 



I 

(2) £ Ii<6k>^i " ^kV ^ ^' k = 1/ 2, / 

i=l 



I 

(3) L Xi = N, 

i=l 



I 

(4) £ v^-jx^ = Wj/ j - 1/ 2/ . • . . # J/ 

i = l 



(5) Xi € {0/ 1)/ i 1/ 2/ , 1, 

(6) y ^ 0, 

In the objective function (1) the vertical location of the 
test information function is maximized. By the constraints in 
(2) (riy/,,,/ rj^y) is a series of lower bounds to the test 
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information function I (Sj^) at ability levels Oj^. The 
constraints in (4) are added as a general provision to deal 
with practical constraints, for instance, on test 
com2»osition, administration time, and the like; for examples, 
see Adema and van der Linden (1989) . Each different 
application of (4) will involve different definitions of v^j 
and Wj« 



The Revised Simplex Method 

In this section the revised simplex method as described 
in Murtagh (1981) is brief] y reviewed, »The revised simplex 
method is ths standard for computer codes for solving linear 
progranming problems, and the method is introduced in most 
text books (e.g., Papadimitriou & Steiglitz, 1982), 
Generally, a linear programming problem with n variables and 
m constraints can be written as: 

n 

(7) maximize c'^x (= L c^Xj^) , 

i=l 

subject to 

n 

(8) Ax = b (I ajj^Xi = bj, j = 1, 2, , m) , 
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(9) X ^ 0 ( Xj^ ^ 0, 1 » i# 2, • . • •# n) # 

\;here (7) is the objective function and equations (8) and (9) 
are constraints. Notice that an inequality constraint 

n 

i=l ^ 

can be written as an equality constraint by introaucing a 
nomiegative ;'ariaDle as follows: 

n 

Z ^ii^i + Sj = bj, 
i=l ^ 

where Sj ^ 0* The variable Sj is called a slack variable. 

If it is assumed that m < n, matrix A can be partitioned 
into submatrices B and D 

A = [bIdI, 

where B is * mxm nonsingular submatrix. Given this partition 
equations (8) can be written as 

BXb + ^' 
where x has been partitioned into 
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X = 



corresponding to the partition of A. Similarly, c is 
partitioned into 



c = 



CD 



Since B is nonsingular xg can be written as 



= B-^b - B"^DX0, 



The m variables in Xg are called the basic variables, 
because they are solved in terms of the other n-m variables 
(nonbasic variables) in x^, A basic solution is defined as 
one in which the nonbasic variables are set at their bounds, 
in this case to zero, A basic feasible solution is a ba'^lc 
solution in which all the terms of the vector B""lb a \ 
nonnegative. Remark, that a large number of partitions lor A 
into B and D exists. The general idea of the simplex method 
is to search through the basic feasible solutions by moving 
frcm one basic feasible solution to an adjacent one with a 
better objective function value. In each iteration a basic 
variable leaves the basis and a nonbasic variable enters the 
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basis, that is, new matrices B and D are chosen. This process 
continues until no further improvement can be obtained • 

Now the steps of the revised simplex method are given. 
For the logic underlying these steps and ^ more detailed 
description of the steps the reader is referred to the 
operations research literature (e.g., Murtagh, 1981). 

Step 1: Prndnce a pricing vector . Evaluate 5*^ = Cb^B"^/ where 
called the pricing vector. 

Step 2 : Prirf> ou t t.^^ nnnbasic variables and select the 
f^nterino nonbasic variable. In the standard form of 

the revised simplex method = 5**i " is 

evaluated for fjach nonbasic variable. It is commom to 

refer to c? as the reduced cost of variable i. The 

variable with the most negative reduced cost d^ is 

chosen as the nonbasic variable entering the basis. 

If no reduced cost is less than zero, then STOP (an 

optimal feasible solution is found) . 

Step 3: Find the leaving basic variable. The computations 
necessary to select the basic variable that leaves 
the basis are executed. 

Step 4: Pivo t . In this step the new B"-^ is computed. Go to 
Step 1. 
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A detailed description of Steps 3 and 4 is not given here, 
because modifications with respect to these steps are not 
made in this paper. 

Modifications in the Revised Simplex Method 

The fully relaxed version of a 0-1 linear programming problem 
is the problem with all constraints 0 ^ x^ ^ 1 instead of x^ 
e {0,1). If for a test construction problem the related fully 
relaxed problem is solved, a good suboptimal 0-1 solution can 
be foxond very fast by methods as rounding and optimal 
rounding. The fully relaxed problem is solvable by the 
simplex method. Thus, to solve a test construction problem 
quickly it is important to have a good implerr^ntation of the 
simplex method. It is the purpose of this paper to present 
implementations of the simplex method that speed up the 
calculations of the solutions considerably and save memory 
space. 

Pricing Strategies 

In Step 2 of the revised simplex method an entering nonbasic 
variable has to be chosen. There are several possibilities of 
choosing this variable; a few of them will be considered -n 
this paper. Generally, the success ^f pricing strategies 
depends on the linear programming problems considered. 
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Strategy 1: The standard strategy. The variable with the most 
negative reduced cost is chosen. 

Strategy 2: Starting from the last selected variable the 
first variable with negative reduced cose is 
selected (see, e.g., Syslo, Deo & Kowalik, 1983, 
p. 14) . 

Strategy 3: The ? variables with the most negative rfiduced 
costs are selected. Then Strategy 1 is applied to 
these P variables until all P variables havci 
nonnegative reduced coot. Again, the P variables 
with the most negative reduced costs are 
selected. Etcetra (see, e.g., Lasdon, p.3ll) . 

Strategy 4: Partial pricing. In this strategy only a part of 
the variables is considered, namely the next P 
variables after the last variable for which the 
reduced cost was computed in the previous 
iteration (see, e.g.. Hartley, 1985, p.64) . 

Strategy 1 is mostly used in the revised simplex method. The 
other pricing strategies might be better with respect to CPU 
time, because the computational burden in Step 2 is reduced 
especially for problems with many variables. On the other 
hand, the number of iterations will probably increase so that 
it is not sure that Strategies 2 through 4 v;ill perfo 
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better. Strategies 1 and 2 are special cases of Strategy 4, 
because Strategy 1 is Strategy 4 with P equal to the number 
of variables (including slack variables) and Strategy 2 is 
Strategy 1 with P = 1. Strategy 1 is also equal to Strategy 3 
with ? = lo 

Prarticaj ronstraints 

Van der Linden and Boekkooi-Timminge (1989) have given an 
overview of possible practical constraints, for instance, 
constraints on administration time and composition of the 
test. Some of the constraints consider items vhich belong to 
the same subdomain of th3 item bank. This implies that the 
columns in matrix A corresponding to these items are partly 
identical , 

Example : 

Suppose we have an item bank for French with 450 items. The 
item bank is divir .d in three subdomains with respect to its 
content : 

Items 1-150: vocabulary itams; 

Items 151-300: grammar items; 

Items 301-450: readina comprehension items. 
The first BO items of each subdomain are assumed to be of the 
multiple choice tvpe; the other items are matching items. 

Now suppose a test constructor wants to have a test with 
the following composition: 
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1) The test should contain 10 vocabulary, 10 grammar, and 10 
reading comprehension items, 

2) Exactly 15 multiple choice and 15 matching items should be 
included in the test. 

The following constraints represent this composition: 



150 

(10) I Xi = 10, 

i=l 



300 

(11) I = 1^/ 

i=151 



450 

(12) I Xi = 10, 

i=301 



80 230 380 
(13) Z Xi + L Xi + Z Xi = 15, 

i=l i=151 i=301 



"SO 300 450 
(14) 2 Xi + Z Xi + Z Xi = 15, 

H-31 i=231 i=381 



If we add these constraints to the Maximin Model we get: 



maximize y. 



subject to 
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X 

y 



s 0, 



A2* = *>2, 

Xi e (0,1), 



1, . 



1/ 



y s 0, 



where 



y 



Al = 



ii(ei) 



ii<ei) -ri 



A2 



150 



1 0 
0 1 



150 



1 0 
0 1 



150 



1 0 
0 1 



80 70 



80 



70 



80 70 
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b2 



10 
10 
10 
15 
15 



We can partition Jc"^ (see Step 1) into k^^ and 7C2'^ where 
712*^ corresponds to the constraints for the composition of the 
test. In the same way each colum » is part-icionable into <x 
part and a2i. Thus, in Step 2 the reduced costs can be 

computed by 



di = T^i^^ii + ^2*^*21 



For items belonginq to the same subdomains we have to compute 

^2^*2i o"^y once. The above implies that CPU time is gained, 
because less computations are needed. Also, we can save 

storage capacity, because we have to store a2i only for 

groups of items and not for each item separately. 



Computational Experience 

Two iter, banks were generated to determine if CPU time is 
gained due to the modifications. Both item banks contained 
450 items. The items of the first item bank fitted the Rasch 
model (bi ^ N(0,1) ) and the items of the other bank fitted 

20 
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the 3-parameter model (a^ . U (0.5, 1.5); ^ N(0,1); 

Ci = 0.1). Three )cinds of tests were constructed (van der 
Linden, 1985) : 

1) Selective tests, that is, tests which give maximal 
information at a cut-off point at the ability continuum. 

2) Classification tests, that is, tests which give maximal 
information at two or more cut-off points. 

3) Diagnostic tests, that is, tests with a flat target 
information function for a specified interval of the ability 
continuum. 

In the Maximin Model the kind of test is specified by the 
test constructor by choosing the number of ability levels 
the ability levels 9)^, and the constants rj^. In the numerical 
experiinents these values were specified as follows: 
(1) K = 1; Qi = 0; and = 1 (selective test); (2) K = 2; 
0^ s= -1^ 02 = 1; and r^^ = r2 = 1 (classification test); and 
(3) K = 3; Qi = -2, 82 = 0. and 83 = 2; and r^ = r2 = r3 = 1 
(diagnostic test) . Observe that the distinction between 
classification and diagnostic tests is not always clear from 
the Specified values. The constraints in (3) and (4) should 
be specified explicitly to make the Maximin Model complete. 
Five different constraint sets were taken inf^ account. 
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i Constraint set 1 

This set 1 contains the constraint: 



(15) 



450 

i=l 



30. 



Constraint (15) implies that 30 items are selected. 
Constraint set 2 

This set 2 contains the constraincs: 



450 

(16) I tiXi ^ 1125, 

i-1 



along with (10) - (14) . 

Constraint (16) is a restriction on the administratis 
time. The coefficient ti (^ U(20,60)) is an estimate of the 
time needed for answering item i. 

Constraint set 3 

Thi?; set 3 contains the constraints: 



j*lO-!'lO 

(17) Z Xi ^ li 

i=j*10+l 



j = 0, , 44, 



along with (10) - (15) 



ERLC 



22 



The Revised Simplex Method 

18 



Suppose the item bank can be partitioned into subsets of 
10 items, such that each item in such a subset contains a cue 
about the other items in the subset. Constraints (17) 
prohibit that mo::-^ than 1 item from such a subset is 
selected. 



Constraint set 4 

This set 4 contains the constraints: 



25 75 425 

(18) I Xi + Z Xi + + Z Xi ^ 10, 

i=l i=51 i=401 



50 100 450 

(19) I Xi + I xi + + I Xi ^ 20, 

i=26 i=76 i=426 



150 

(20) L Xi ^ 10, 

i=l 



300 

(21) I Xi ^ 12, 

i=151 



450 

(22) I Xi ^ 8, 

i=301 



along with (15) - (16) . 

Constraints (18) - (?2) control the composition of the 

test. 
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Con5^train t <^et 5 



This set 5 contains the constraints: 



(23) 



3*50+50 

L ^ 5, 

i=j*50+l 



j = 0, , 8, 



along with (15), (16), (18) - (22), 

The item bank is assumed to be partitioned in subsets of 
50 items. According to constraints (23) at most 5 items are 
selected from these subsets. 

The modifications in the revised simplex method were 
implemented in the computer program LINPROG (Anthonisse, 
1984). All experiments were conducted on an 01 \:v i M24 
personal computer with hardcard and without mathematical 
coprocessor. In the CPU times reported in Tables 1 through 9 
the times for reading the input file, for the initialization, 
and for writing to the output file are not included. 

For the P value in Strategy 3 usually an integer value 
ranging from 2 to 10 is chosen (Lasdon, 1970, p,311) , In our 
experiments the values 5 and 10 were chosen. The P values in 
Strategy 4 were chosen to be 50, 100, 150, 200, and 250, For 
higher values of P Strategy 4 can not be much better than 
Strategy 1, because the computational burden in St ip 2 is not 
much smaller. 
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In Table 1 the CPU times (in sees,) and numbers of 
iterations are given for the construction of tests froH» both 
item banks. The pricing strategy was varied, and selective, 
classification and diagnostic tests were constructed. 



Constraint Set 1 was used implying that the modifications for 
practical constraints were not applied. Strategy 4 w^th small 
values of P gave the best results. 

In Tobies 2 through 9 CPU times (in sees,) and numbers 
of iterations are given. In each table the item bank and 
constraint set were fixed while the pricing strategies and 
the kind of test were varied. In all the tables results for 
the unmodified as well as the revised simplex method with 
modification for the practical constraints are given. 



There should not be a difference in the number of iterations 
between the modified and unmodified revised simplex method. 
However, differences did occur and mostly they occured for 
pricing strategies that allowed for very small increments of 



Insert Table 1 here 



Insert Table 2 



- 9 here 
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the objective function values. Thus, numerical inpreciisicn 
may h^ve caused these differences (Obsreve, however, that the 
optimal solutions eventually were always equaM , If numerical 
problems did not occur, the modified method ^as always faster 
than the unmodified method* In all tables the same tendency 
is seen: Strategy 1 and 2 are in general the worst pricinr 
strategies. The best results gives Strategy 4. 

In Table 10 the objective function values ar^d the 
numbers of variables with fractional values in the optimal 
solution are given for all generater" problems. 



Insert Table 10 here 



Table 10 shows that most of the practical constraints had 
some effect on the solution of the problem. Constraints (23), 
however, were redundant except for one case. 

Discussion 

The construction of tests by 0-1 linear programming is a new 
development in item resp'^nse theory. In this paper some test 
construction problems based on the Maximin Model were 
introduced and numerical experiments were conducted. The 
conclusions in this section are based on the numerical 
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experiments on the proposed test construction problems with 
the computer program LINPROG. Although, the Maximin Model was 
used in the experiments it should be clear that the pricing 
strategies and modification for practical constraints can 
also be applied to other test construction models. 

The tables show that for an item bank calibrated under 
the 3-parameter model the tests are constructed faster and 
that the number of iterations is smaller than for an item 
bank calibrated under the Rasch model. For the 3-parameter 
model the differences between the item information functions 
are larger, which makes it easier for the revised simplex 
method to make the distinction between "good" and "bad" 
items . 

Only Step 2 in the revised simplex method depends on the 
pricing strategy. Table 1 through 9 illustrate that it is the 
most time consuming step and that determining the variable to 
leave the basis and computing is not so time consuming. 

The amount of computations to be executed in Step 2 is 
heavily influenced by the number of variables in the model. 
For the other steps only the number of constraints is 
important. In the numerical experiments 450 variables 
corresponding to the items were present. If this number is 
increased, the CPU time will probably increase and the larger 
part of this increment is caused by Step 2. Hence, if the 
model contains mors variables, the gain by using fast pricing 
strategies for Step 2 will probably be larger. 
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Strategy 1 does not necessarily need fewer iterations 
than the other pricing strategies. For instance, in Table 2 
the number of iterations for Strategy 1 is not the smallest 
for all kind of tests. This explains the success of Strategy 
4: The number of computations per iteration is much smallei. 
especially for low values of P, whereas the number of 
iterations is in most cases not much larger and sometimes 
even smaller. 

in general Strategy 4 gives the best results, although 
Strategy 3 is sometimes better (see Table 9) • The problem 
with Strategy 4 is the choice of the P value. Strategies 1 
and 2 are special cases of Strategy 4 and do not give good 
results. From this one can conclude that P should not be too 
small or too large. Th" tables show that P = 50 as well as P 
= 200 and the values in between yield fast CPU times. Of 
course, the optimal choice of P depends on the number of 
items in the item bank (P = 200 for a bank with 200 items is 
not likely to be a good choice) . 

Beside the pricing strategies mentioned in this paper 
other strategies are possible (e.g., Goldfarb & Reid, 1977; 
Harris, 1973; Kuhn & Quandt, 1963). in this paper the choice 
of pricing strategies was restricted to strategies which are 
easy to implement in an existing computer program. 

The modification for practical constraints is an 
improvement, except for some cases where the number of 
iterations between the modified and unmodified method 
differs. Noc the number of added constraints is important, 
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but the number of nonzero coefficients in the columns of 
matrix A, because in LINPROG multiplications with zero are 
omitted. The improvement in CPU time, for instance, is larger 
for Constraint Set 5 than for Constraint Set 3 although the 
number of constraints is larger in the latter. It can be seen 
that with respect to the pricing strategies the modification 
is most effective for Strategy 1 and least effective for 
Strategy 2. The larger the value of P in Strategy 4 the 
larger the improvement in CPU time. 

The number of constraints in (8) is an upper bound for 
the number of variables with fractional values in the 
solution of a linear programming problem. From Table 10 a 
distinction can be made between hard and easy constraints, 
where the hard constraints play an important role in causing 
variables with fractional values. In the hard constraints the 
coefficients are real valued; they correspond with the 
administration time and the test information function 
constraints. The easy constraints have coefficients 0 or 1 
and an integer as right hand side; they correspond with 
constraints with respect to the composition of the test. In 
the combinatorial optimization literature one can find 
conditions under which the solution of a linear pro^^ -amming 
problem is guaranteed to be integer (see e.g. Papdimitriou & 
Steig.itz, 1982; Schrijver, 1986) . 
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Table 1 

Rfij^nlts for tne Revised Simp lex Method Without Modification 
nndf^r Constraint Set 1 



Rasch 



S-p arameter 







CPU 


« 


CPU 


* 


ategy 


pa 


time 


Iterations 


time 


Iterations 




(sees. ) 


(sees. 


) 








Select Lve Test 






1 


n«a. 


103 


90 


103 


ft Q 


2 


n.a. 


138 


2 92 


134 




3 


5 


89 


9w 


89 


i7U 




10 


86 


90 


89 




4 


50 


34 


118 


32 


114 




100 


39 


101 


38 


101 




150 


47 


96 


49 


99 




200 


56 


93 


57 


95 




OCA 

250 


68 


95 


61 


88 






Classification Test 




1 


n • a • 


167 


110 


168 


111 


2 


n • a • 


423 


767 


166 


250 


3 


c 
O 


150 


139 


101 


11 ft 

X X o 




1 A 


190 


177 


118 


130 


4 


50 


136 


213 


62 


137 


100 


110 


165 


79 


loo 




150 


114 


148 


86 


121 




200 


148 


157 


103 


122 




250 


125 


125 


114 


117 








Diagnostic Test 






1 


n*a. 


214 


120 


163 


97 


2 


n .a. 


466 


384 


380 


347 


3 


5 


191 


158 


140 


120 




10 


182 


163 


108 


115 


4 


50 


95 


159 


82 


144 




100 


105 


146 


78 


117 




150 


123 


140 


110 


129 




200 


136 


133 


125 


126 




250 


151 


129 


127 


116 



^ n.a. = not applicable 
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i Table 2 

: Results for the Revised Sim plex Method under Constraint Sot 2 

for the Tt.em Bank Calibrat ed under the Rasch model 



Strategy 


pa 


Unmodified 


Modified 




CPU # 

time Iterations 
(sees. ) 


CPU # 

time Iterations 
(sees.) 








Selective Test 






1 


n . a « 


298 


153 


242 


153 


2 


n . a • 


430 


501 


407 


501 


3 


O 


233 


174 


199 


174 




lU 


247 


195 


212 


195 


4 


50 


152 


192 


141 


192 




luu 


93 


193 


125 


Ibo 




150 


153 


155 


139 


ICO 

loo 




200 


164 


147 


138 


147 




250 


203 


156 


171 


156 






Classification Test 




1 


n « a « 


433 


177 


368 


177 




n « a « 


587 


807 


561 


833 


■a 


c 
O 


430 


230 


385 


230 




J. u 


514 


275 


470 


275 






290 


240 


403 


289 




inn 
1 u u 


220 


195 


334 


248 




150 


232 


176 


209 


176 




200 


291 


187 


261 


187 




250 


313 


183 


277 


183 








Diagnostic Test 






1 


n, a. 


485 


176 


420 


176 


2 


n. a. 


395 


611 


394 


675 


3 


5 


413 


217 


374 


217 




10 


393 


222 


358 


222 


4 


50 


341 


242 


328 


242 




100 


239 


186 


222 


186 




150 


348 


207 


322 


207 




200 


223 


148 


198 


148 




250 


304 


165 


270 


165 



^ n,a. - not applicable 
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Table 3 

Rft Rnlts for the Rev j .^t. S^^P^^x Method under Constraint Set 2 
for the Item Bank v :> vibrated under the 3-parameter model 



Unmodified Modified 



CPU # CPU » 

Strategy P^ time Iterations time Iterations 

(sees.) (sees.) 



Seleetive Test 



1 


n. a . 


225 


127 


179 


127 


i 


2 


n. a. 


427 


434 


396 


458 




3 


5 


178 


135 


145 


135 


1 




10 


164 


150 


137 


150 




4 


50 


95 


150 


86 


150 


'$ 




100 


82 


164 


111 


149 


s 

i 




150 


120 


132 


101 


130 






200 


140 


129 


117 


129 






250 


169 


137 


141 


137 








Classifieation Test 






1 


n.a. 


295 


135 


245 


135 




2 


n. a . 


533 


528 


513 


533 




3 


5 


333 


199 


296 


199 






10 


215 


164 


186 


164 




4 


50 


144 


168 


222 


214 






100 


238 


199 


192 


184 






150 


242 


181 


217 


181 






200 


273 


177 


243 


177 






250 


248 


158 


216 


158 


'J 








Diagnostie Test 








1 


n.a. 


384 


150 


329 


150 




2 


n.a. 


410 


695 


401 


723 




3 


5 


361 


195 


324 


195 






10 


323 


199 


291 


199 




4 


50 


216 


190 


206 


190 






100 


212 


171 


197 


171 






150 


281 


183 


257 


183 






200 


208 


142 


185 


142 


\ 




250 


236 


142 


207 


142 





^ n.a. = not applieable 
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^ Table 4 

Rfignlts for the Revised Simpl ex Method under Constraint Set 3 
fnr the Item Bank Ca librated under the Rasch model 



Unmodi f ied Modi f ijed 



CPU # CPU # 

Strategy P^ time Iterations time Iterations 

(sees,) (secsj 



Selective Test 

1 n,a, 358 147 288 147 

2 n,a, 339 302 329 302 

3 5 213 151 170 151 
10 206 178 167 178 

4 50 138 151 125 151 
100 196 169 173 167 
150 157 128 127 147 
200 146 119 122 119 
250 217 159 155 ?28 







Classification Test 




1 


n. a. 


571 


198 


479 


198 


2 


n.a. 




655 


559 


655 


3 


5 


338 


231 


284 


231 




10 


339 


241 


289 


241 


4 


50 


212 


174 


200 


174 




100 


324 


207 


329 


237 




150 


279 


168 


251 


168 




200 


296 


200 


257 


200 




250 


320 


200 


363 


200 








Diagnostic Test 






1 


n.a. 


511 


180 


428 


180 


2 


n.a. 


422 


527 


411 


527 


3 


5 


324 


190 


276 


190 




10 


288 


195 


247 


195 


4 


50 


285 


255 


267 


255 




100 


245 


189 


225 


192 




150 


288 


194 


257 


194 




200 


312 


184 


275 


184 




250 


303 


163 


294 


179 



^ n a. = not applicable 
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Table 5 % 

RAi^nits for the Revi sed Simplex Method under Constraint Set 3 /| 

for t. hft T^^**^"^ ^-^rik ralibrated undar the 3-parameter model I 



Unmodified Modified 



CPU # CPU # 

Strategy P^ time Iterations time Iterations 

(sees,) (secsj 



Selective Test 



1 


n . a • 


217 


104 


169 


104 


2 


n . a . 


294 


278 


283 


278 


3 


5 


174 


124 


137 


124 




10 


138 


113 


108 


113 


4 


50 


93 


117 


83 


117 




100 


111 


121 


97 


121 




150 


134 


118 


121 


136 




200 


117 


101 


95 


101 




250 


159 


124 


142 


116 






Classification Test 




1 


n.a. 


312 


123 


253 


123 


2 


n.a. 


396 


384 


386 


384 


3 


5 


227 


156 


189 


156 




10 


245 


178 


205 


178 


4 


50 


306 


220 


288 


220 




100 


310 


195 


281 


193 




150 


267 


167 


241 


167 




200 


225 


157 


194 


157 




250 


240 


153 


260 


152 








Diagnostic Test 






1 


n.a. 


457 


160 


382 


160 


2 


n.a. 


468 


583 


456 


583 


3 


5 


282 


155 


238 


155 




10 


294 


188 


253 


188 


4 


50 


241 


214 


226 


214 




100 


196 


155 


179 


155 




150 


206 


134 


183 


134 




200 


284 


165 


250 


165 




250 


340 


178 


235 


148 



^ n.a, = not applicable 
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Table 6 

.esults for the Revised Simplex Me thod under Constraint Set 4 
for the Tf.em Bank Calibrated under the Rasch model 

Unmodi f led Modi f led 



CPU # CPU # 

Strategy time Iterations time Iterations 

(sees,) (sees,) 



Selective Test '/} 



1 


n . a • 


194 


110 


151 


110 


2 


n . a • 


338 


320 


328 


320 


3 


5 


177 


138 


146 


138 




10 


171 


148 


145 


148 


4 


50 


110 


153 


100 


153 




100 


130 


148 


115 


148 




150 


136 


144 


115 


144 




200 


139 


126 


114 


126 




250 


151 


126 


123 


126 






Classification Test 




1 


n. a. 


340 


144 


284 


144 


2 


n. a. 


433 


65*^ 


421 


655 


3 


5 


383 


206 


339 


206 




10 


328 


212 


299 


212 


4 


50 


342 


257 


290 


240 




100 


309 


221 


287 


221 




150 


325 


209 


294 


209 




200 


374 


213 


333 


213 




250 


291 


172 


254 


172 








Diagnostic Test 






1 


n.a. 


350 


139 


295 


139 


2 


n. a. 


247 


414 


238 


414 


3 


5 


302 


179 


269 


179 




10 


278 


185 


252 


185 


4 


50 


192 


195 


181 


195 




100 


204 


165 


187 


165 




150 


247 


168 


223 


168 




200 


302 


174 


269 


174 




250 


275 


152 


240 


152 



^ n.a. = not applicable 
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Table T 

Results for the Rev ised Simplex Method under Constraint Set 4 
for the Item Bank Calibrated under the 3-paramfttftr modal 



Unmodified Modified 



CPU # CPU f 

Strategy P^ time Iterations time Iterations 

(sees.) (sees.) 



Selective Test 



1 


n • a • 


179 


104 


140 






n • a • 


456 


364 


445 




o 
J 


c 
O 


140 


124 


116 






1 u 


120 


123 


102 




H 


ou 


97 


145 


88 






inn 
1 u u 


95 


125 


82 








123 


131 


102 


1 O 1 




5 n n 
z u u 


103 


106 


83 


1 n^ 

1 U Q 




250 


121 


106 


96 


106 






Classification Test 




1 


n.a. 


274 


124 


226 


124 


2 


n.a. 


388 


437 


379 


437 


3 


5 


^73 


184 


244 


184 




10 


163 


145 


145 


145 


4 


50 


182 


186 


186 


194 




100 


134 


140 


119 


140 




150 


155 


135 


134 


135 




200 


175 


136 


150 


136 




250 


237 


148 


204 


148 








Diagnostic Test 






1 


n,a. 


240 


104 


199 


104 


2 


n,a. 


230 


395 


222 


395 


3 


5 


222 


140 


194 


140 




10 


207 


147 


185 


147 


4 


50 


163 


163 


154 


163 




100 


191 


160 


175 


160 




150 


187 


144 


167 


144 




200 


18'^ 


131 


164 


131 




250 


2<5 


144 


213 


144 



n.a. = not applicable 
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Table 8 

R^fiulns for the R<>vised Simplex M ^thpd undgr Constraint Set 5 
fo^ Che ;tem Bank Calibrated under the Rasch model 



Unmodified Modified 



CPU « CPU * 

Strategy time Iterations time Iterations 

(sees.) (sees.) 



Selectiv* Test 



1 


n. a. 


263 


129 


193 


129 


2 


n. a . 


381 


463 


363 


516 


3 


5 


140 


155 


116 


167 




lu 


138 


172 


104 


172 


4 


50 


118 


148 


107 


148 




100 


159 


154 


140 


154 




150 


188 


163 


157 


163 




200 


198 


152 


161 


152 




250 


186 


133 


148 • 


133 






Cl^^ssification Test 




1 


n.a. 


472 


178 


377 


178 


2 


n. a. 


398 


1005 


348 


914 


3 


5 


246 


223 


195 


227 




10 


207 


222 


164 


222 


4 


50 


204 


249 


186 


249 




100 


222 


215 


197 


215 




150 


254 


184 


219 


184 




200 


273 


176 


234 


176 




250 


330 


199 


275 


199 








Diagnostic Test 






1 


n.a. 


381 


. 151 


301 


151 


2 


n.a. 


257 


633 


209 


573 


3 


5 


253 


213 


201 


210 




10 


228 


233 


208 


233 


4 


50 


135 


192 


121 


192 




100 


170 


177 


146 


177 




150 


200 


176 


168 


176 




200 


199 


142 


166 


142 




250 


282 


175 


231 


175 



n,a, = not applicable 
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Table 9 

R<>fiults f or the Revised Simplex Method under Consl:raint Set, S 
for the I tem Bank Calibrated \mder the 3-paramet:er model 



Unmodified Modified 



CPU # CPU # 

Strategy P^ time Iterations time Iterations 

(sees.) (sees,) 



Selective Test 



1 


n.a. 


218 


111 


159 


111 


2 


n.a. 


3^0 


524 


360 


519 


3 


5 


98 


116 


85 


137 




10 


85 


119 


64 


119 


4 


50 


132 


159 


120 


159 




100 


150 


150 


129 


150 




150 


139 


130 


114 


130 




200 


120 


110 


94 


110 




250 


193 


139 


155 


139 






Classification test 




1 


n.a. 


349 


142 


274 


142 


2 


n.a. 


253 


522 


250 


557 


3 


5 


190 


180 


128 


3 61 




10 


142 


168 


111 


168 


4 


50 


175 


199 


160 


199 




100 


198 


179 


176 


179 




150 


255 


177 


221 


177 




200 


207 


136 


176 


136 




250 


217 


132 


181 


132 








Diagnostic Test 






1 


n.a. 


335 


133 


263 


133 


2 


n.a. 


245 


614 


219 


581 


3 


5 


240 


202 


164 


177 




10 


209 


199 


171 


199 


4 


50 


117 


163 


105 


163 




100 


165 


169 


142 


169 




150 


176 


153 


148 


153 




200 


205 


143 


170 


143 




250 


214 


137 


176 


137 



^ n.a. = not applicable 
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Table 10 

Ob jective Function Values and Number of Fractional Values in 
the Solutions of thf^ Proble ms Correspondiny to Table 1 
through 9 



Selective Classification Diagnostic 





Obj. 


* 


Obj. 


# 


Obj* 


# 




Func. 


Frac. 


Func. 


Frac. 


Func . 


Frac 


Table^> 


Value 


Values 


Value 


Values 


Value 


Values 


1(R) 


7.4948 


0 


5.:969 


2 


4.0073 


3 


l(3p) 


12.2783 


0 


7.5496 


2 


4.7022 


3 


2 


7.4915 


4 


5.8960 


6 


4.0048 


6 


3 


12.2633 


4 


7.5344 


6 


4.6805 


5 


4 


7.4864 


2 


5.8945 


4 


3.9928 


8 


5 


11.9881 


2 


7.4521 


4 


4.5462 


6 


6 


7.4916 


2 


5.8959 


3 


4.0049 


4 


7 


12.2726 


2 


7.5496 


2 


4.6648 


5 


8 


7.4916 


2 


5.8959 


3 


4.0048 


6 


9 


12.2726 


2 


7.5496 


2 


4.6606 


5 



^ The table r JDers are used to identify the problem at hand. 
In Table 1 rei-?ults for an item bank calibrated under the 
Rasch model (R) and a bank calibrated under the 3-parameter 
model (3p) are given. 
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